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DETAILED ACTION 



1. Claims 1-18 are pending in this office action. 



Information Disclosure Statement 



2. Applicants' Information Disclosure Statements, filed on 04/09/2004, 
8/11/2005 and 9/19/2005 have been received, entered and considered. See 
attached form PTO-1449. 



Specification 



3. Specification is objected to because related co-pending application, given 
in the specification needs to be updated by including the U.S. Patent Application 
Serial number. 



Double Patenting 



4. The nonstatutory double patenting rejection is based on a judicially 
created doctrine grounded in public policy (a policy reflected in the statute) so as 
to prevent the unjustified or improper timewise extension of the "right to exclude" 
granted by a patent and to prevent possible harassment by multiple assignees. 
A nonstatutory obviousness-type double patenting rejection is appropriate where 
the conflicting claims are not identical, but at least one examined application 
claim is not patentably distinct from the reference claim(s) because the examined 
application claim is either anticipated by, or would have been obvious over, the 
reference claim(s). See, e.g., In re Berg, 140 F.3d 1428, 46 USPQ2d 1226 (Fed. 
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Cir. 1998); In re Goodman, 11 F.3d 1046, 29 USPQ2d 2010 (Fed. Cir. 1993); In 
re Long/, 759 F.2d 887, 225 USPQ 645 (Fed. Cir. 1985); In re Van Ornum } 686 
F.2d 937, 214 USPQ 761 (CCPA 1982); In re Vogel, 422 F.2d 438, 164 USPQ 
619 (CCPA 1970); and In re Thorington, 418 F.2d 528, 163 USPQ 644 (CCPA 
1969). 

A timely filedterminal disclaimer in compliance with 37 CFR 1 .321(c) or 
1.321(d) may be used to overcome an actual or provisional rejection based on a 
nonstatutory double patenting ground provided the conflicting application or 
patent either is shown to be commonly owned with this application, or claims an 
invention made as a result of activities undertaken within the scope of a joint 
research agreement. 

Effective January 1 , 1994, a registered attorney or agent of record may 
sign a terminal disclaimer. A terminal disclaimer signed by the assignee must 
fully comply with 37 CFR 3.73(b). 



Claims 1, 5, 7, 11, and 13 are provisionally rejected under the judicially 
created doctrine of obviousness-type double patenting over claims 1, 21, 24, and 
35 of copending Application No. 10,792,175. Although the conflicting claims are 
not identical, they are not patentably distinct from each other for the reason set 
forth hereinbelow. 

Claims of instant application 10,715,162 are essentially the same as 
claims of copending application 10,792,175 except that the instant application 
recites "time bar that divides time segments having a size." The copending 
application has timeline view that is presented in combination with media view 
and provides access to media files. 

It would have been obvious to a person of ordinary skill in art at the time 
the invention was made to use segments of time with different size to provide 
access to media files in a time period of a time bar. 
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Claims 1, 2, 9, 10, 11 and 13 are provisionally rejected under the judicially 
created doctrine of obviousness-type double patenting over claims 1, 2, 3, 8, 9 
and 22 of copending Application No. 10,738,006. Although the conflicting claims 
are not identical, they are not patentably distinct from each other for the reason 
set forth hereinbelow. 

Claims of instant application 10,715,162 are essentially the same as 
claims of copending application 10,738,006 except that the instant application 
recites "second instructions for generating a time bar that divides time into 
segments having a size that depends upon the media files associated with the 
respective segment of time" but co-pending application recites "second 
instructions for generating a media handle, displayed in conjunction with a media 
view, wherein the media handle is moveable within the media view to provide 
viewable access to digital media files." 

It would have been obvious to a person of ordinary skill in art at the time 
the invention was made to divide the time bar to provide access to different time 
periods in a segmented time bar. 

Claims 1, 3, 11 and 13 are provisionally rejected under the judicially 
created doctrine of obviousness-type double patenting over claims 1, 8, 9 and 16 
of copending Application No. 10,715,161. Although the conflicting claims are not 
identical, they are not patentably distinct from each other for the reason set forth 
hereinbelow. 
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Claims of instant application 10,715,162 are essentially the same as 
claims of copending application 10,715,161 except that the instant application 
recites "divided time bar for media file" but the co-pending application is reciting 
"topographic view representing media files." 

It would have been obvious to a person of ordinary skill in art at the time 
the invention was made to divide the time bar to provide access to different time 
periods in a segmented time bar instead of dividing graphical representation into 
one or more portions. 

Claims 1,11 and 13 are provisionally rejected under the judicially created 
doctrine of obviousness-type double patenting over claims 1 , 4, 37 and 39 of 
copending Application No. 10,715,187. Although the conflicting claims are not 
identical, they are not patentably distinct from each other for the reason set forth 
hereinbelow. 

Claims of instant application 10,715,162 are essentially the same as 
claims of copending application 10,715,187 except that the instant application 
recites "views of media view and the time bar" but the co-pending application 
recites "views of calendar and media views." 

It would have been obvious to a person of ordinary skill in art at the time 
the invention was made to provide the display of the files that are associated with 
a time bar instead of displaying calendar events with combination to media view, 
thereby limiting the search time of files according to the time bar. 
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The following tables show the claims in the instant application 10715162 
that are rejected by corresponding claims in 10792175, 10738006, 10715161 
and 10715187. 



Instant 
Application # 
10715162 


Co-pending 
Application # 
10792175 


Co-pending 
Application # 
10738006 


Co-pending 
Application # 
10715161 


Co-pending 
Application # 
10715187 


Claim 1 


Claim 1 


Claim 1 & 2 


Claim 1 & 9 


Claim 1 & 4 


Claim 5 


Claim 24 








Claim 7 


Claim 21 








Claim 11 


Claim 35 


Claim 22 


Claim 16 


Claim 37 & 39 


Claim 13 


Claim 35 


Claim 22 


Claim 16 


Claim 37 & 39 


Claim 2 




Claim 3 






Claim 9 




Claim 8 






Claim 10 




Claim 9 






Claim 3 






Claim 8 





"A later patent claim is not patentably distinct from an earlier patent if the 
later claim is obvious over, or anticipated by, the earlier claim. In re Longi , 759 
F.2d at 896, 225 USPQ at 651 (affirming a holding of obviousness-type double 
patenting because the claims at issue were obvious over claims in four prior art 
patents); In re Berg , 140 F.3d at 1437, 46 USPQ2d at 1233 (Fed. Cir. 1998) 
(affirming a holding of obviousness-type double patenting where a patent 
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application claim to a genus is anticipated by a patent claim to a species within 
that genus)." ELI LILLY AND COMPANY v BARR LABORATORIES, INC., United 
States Court of Appeals for the Federal Circuit, ON PETITION FOR HEARING 
EN BANC (DECIDED: May 30, 2001). 

This is a provisional obviousness-type double patenting rejection. 



Claim Rejections - 35 USC § 101 



5. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or 
composition of matter, or any new and useful improvement thereof, may obtain a patent 
therefor, subject to the conditions and requirements of this title. 



Claims 1-12 are rejected under 35 U.S.C. 101 as being directed to non- 
statutory subject matter. The language of the claims raises a question as to 
whether the claims are directed merely to an environment or machine which 
would result in a practical application producing a concrete useful, and tangible 
result to form the basis of statutory subject matter under 35 U.S.C. 101. 

Claims 1-10 are rejected because the actions performed by first and 
second instructions do not provide any tangible results. 

Claims 11-12 are rejected because they appear to be program per se 
because they include computer readable program instructions. It is unclear 
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whether these computer readable program instructions are stored on a computer 
readable storage medium. 

To expedite a complete examination of the instant application the claims 
rejected under U.S.C. 101 (nonstatutory) above are further rejected as set forth 
below in anticipation of application amending these claims to place them within 
the four categories of invention. 

Claim Rejections - 35 USC § 102 

6. The following is a quotation of the appropriate paragraphs of 35 
U.S.C. 1 02 that form the basis for the rejections under this section made in this 

Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in 
public use or on sale in this country, more than one year prior to the date of application for patent in 
the United States. 

Claims 1-11 and 13-18 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Rothmuller et al. (Rothmuller hereinafter) (International Pub No. 
WO 02/057959 A2). 



With respect to claim 1, Rothmuller teaches an application for 
representing media files on a digital device, the application comprising a 
computer readable storage medium having computer-readable program 
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instructions embodied in the medium, the computer-readable program 
instructions comprising: 

"First instructions for generating a media view" as figure 1, Image 
area 100 provides a media view (Rothmuller Figure 1) "that provides access 
to digital media files and associates digital media files with a predefined 
time" as when the objects to be search for are photos, these search criteria can 
include, but are not limited to, the date and time the photos were taken, textual 
information that is associated with the photos such as the names of the people 
who are in the photos or the places or events where the photos were taken, 
designations of the photos as favorite photos, and designation of the photos as 
photos that have been printed, shared with others, or archived on a certain date 
(Rothmuller Page 2, Lines 13-19). These media files are being accessed based 
on the association of these media files with respect to their data and time. 

"second instructions for generating a time bar that divides time into 
segments having a size that depends upon the media files associated with 
the respective segment of time" as the temporal metadata associated with the 
photos can be used to present a histogram of photos in the form of a timeline 250 
shown in fig 1. The timeline 250 can show the number of photos take as function 
of time over some period of time that can rage from the time the first photo in the 
database was taken to the present. The timeline 250 can be used by itself, or 
with other tags 350 to specify the criteria used to search for matching photos. 
The timeline includes adjustable time bands 251 that can be moved to allow 
timeline 250 to specify the time period that is used to find matching photos 
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(Rothmuller Page 7, Lines 27-31 & Page 8, Lines 1-3). Examiner interprets the 
segments as time bands having a size/time period and media files associated 
with that size. 

With respect to claim 2, Rothmuller teaches "the application of claim 1, 
wherein the second instructions for generating a time bar further generates 
selectable segments of time" as the timeline includes adjustable time bands 
251 that can be moved to allow timeline 250 to specify the time period that is 
used to find matching photos (Rothmuller Page 8, Lines 2-3). Examiner 
interprets selectable as adjustable. 

With respect to claim 3, Rothmuller teaches "the application of claim 1, 
wherein the second instructions for generating a time bar includes 
instructions for generating segments of time periods chosen from the 
group consisting of a year, a month, a week and a day" as the timeline 250 
can be used by itself to find all photos taken between Jan 1 , 2000 and Feb 28, 
2000 by moving the adjustable time bands 251 to these two respective dates 
(Rothmuller Page 8, Lines 8-10). 

Claim 14 is essentially the same as claim 3 except it recites the claimed 
invention as a method and is rejected for the same reasons as applied herein 
above. 
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With respect to claim 4 Rothmuller teaches "the application of claim 1, 
wherein the second instructions for generating a time bar includes 
instructions for generating a segment of time that indicates the amount of 
media files in the time segment" as the temporal metadata associated with the 
photos can be used to present a histogram of photos in the form of a timeline 250 
shown in fig 1 . The timeline 250 can show the number of photos take as function 
of time over some period of time that can rage from the time the first photo in the 
database was taken to the present. The timeline 250 can be used by itself, or 
with other tags 350 to specify the criteria used to search for matching photos. 
The timeline includes adjustable time bands 251 that can be moved to allow 
timeline 250 to specify the time period that is used to find matching photos 
(Rothmuller Page 7, Lines 27-31 & Page 8, Lines 1-3). 

With respect to claim 5, Rothmuller teaches "the application of claim 4, 
wherein the second instructions for generating a time bar includes 
instructions for generating a segment of time that indicates the amount of 
media items in the segment based on the size of the segment" as the 

temporal metadata associated with the photos can be used to present a 
histogram of photos in the form of a timeline 250 shown in fig 1. The timeline 
250 can show the number of photos take as function of time over some period of 
time that can rage from the time the first photo in the database was taken to the 
present. The timeline 250 can be used by itself, or with other tags 350 to specify 
the criteria used to search for matching photos. The timeline includes adjustable 
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time bands 251 that can be moved to allow timeline 250 to specify the time 
period that is used to find matching photos (Rothmuller Page 7, Lines 27-31 & 
Page 8, Lines 1-3). 

With respect to claim 6, Rothmuller teaches "the application of claim 4, 
wherein the second instructions for generating a time bar includes 
instructions for generating a segment of time that indicates the amount of 
media items in the segment unit based on the color of the segment" as 

when tag searches are conducted in conjunction with timeline 250, the timeline 
displays the total number of photos in the database per unit time period in a first 
color which may be a solid color, and the total number of photos in the database 
that match the tagged search criteria as "best" or "close" matches in a second 
color which may be a hatched pattern or color (Rothmuller Page 8, Lines 21-26). 

With respect to claim 7, Rothmuller teaches "the application of claim 1, 
wherein the second instructions for generating a time bar additionally 
includes instructions for generating a time handle that allows for periods of 
time to be scrolled" as figure 1 and figure 3, which shows the time 
handle/arrows to scroll the time periods (Rothmuller Figure 1 & 3). 

With respect to claim 8, Rothmuller teaches "the application of claim 1, 
wherein the first instructions further include instructions for associating 
digital media files with a predefined time based upon information 
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associated with the digital media file" as when the objects to be search for are 
photos, these search criteria can include, but are not limited to, the date and time 
the photos were taken, textual information that is associated with the photos such 
as the names of the people who are in the photos or the places or events where 
the photos were taken, designations of the photos as favorite photos, and 
designation of the photos as photos that have been printed, shared with others, 
or archived on a certain date (Rothmuller Page 2, Lines 13-19). These media 
files are being accessed based on the association of these media files with 
respect to their data and time. 

Claim 15 is essentially the same as claim 15 except it recites the claimed 
invention as a method and is rejected for the same reasons as applied herein 
above. 

With respect to claim 9, Rothmuller teaches "the application of claim 1, 
further including third instructions for generating a calendar view that 
represents time in calendar format and associates events with respective 
periods of time" as in addition to timelines, the temporal distribution of objects 
in the database can be represented in a calendar view such that the days of the 
calendar indicate the number of objects having metadata associated with a given 
day of the week in a given week of the month (Rothmuller Page 3, Lines 10-16). 
In addition tags in the events category can include pre-defined calendar event 
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such as New Years Eve, and customized calendar events such as birthdays and 
anniversaries (Rothmuller Page 5, Lines 21-23). 

With respect to claim 10, Rothmuller teaches "the application of claim 
9, wherein the first instructions for generating a media view that provides 
access to digital media files and associates digital media files with a 
predefined time, associates digital media files with a past predefined time 
and wherein the third instructions for generating a calendar view that 
represents time in calendar format and associates events with respective 
periods of time, associates events with respective future periods of time" 
as figure 1, Image area 100 provides a media view (Rothmuller Figure 1). When 
the objects to be search for are photos, these search criteria can include, but are 
not limited to, the date and time the photos were taken, textual information that is 
associated with the photos such as the names of the people who are in the 
photos or the places or events where the photos were taken, designations of the 
photos as favorite photos, and designation of the photos as photos that have 
been printed, shared with others, or archived on a certain date (Rothmuller 
Page 2, Lines 13-19). These media files are being accessed based on the 
association of these media files with respect to their data and time. 

In addition to timelines, the temporal distribution of objects in the database 
can be represented in a calendar view such that the days of the calendar indicate 
the number of objects having metadata associated with a given day of the week 
in a given week of the month (Rothmuller Page 3, Lines 10-16). In addition tags 
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in the events category can include pre-defined calendar event such as New 
Years Eve, and customized calendar events such as birthdays and anniversaries 
(Rothmuller Page 5, Lines 21-23). 

With respect to claim 1 1 , Rothmuller teaches a digital device, the 
device comprising: 

"a processing unit that executes computer-readable program 
instructions for accessing media files, the computer-readable program 
instructions comprising" as a programmable processor executing a program of 
instruction to perform functions of the invention by operating on input data and 
generating output (Rothmuller Page 12, Lines 19-21). 

"first instructions for generating a media view" as figure 1, Image area 
100 provides a media view (Rothmuller Figure 1) "that provides access to 
digital media files and associates digital media files with a predefined time" 
as when the objects to be search for are photos, these search criteria can 
include, but are not limited to, the date and time the photos were taken, textual 
information that is associated with the photos such as the names of the people 
who are in the photos or the places or events where the photos were taken, 
designations of the photos as favorite photos, and designation of the photos as 
photos that have been printed, shared with others, or archived on a certain date 
(Rothmuller Page 2, Lines 13-19). These media files are being accessed based 
on the association of these media files with respect to their data and time. 



Application/Control Number: 10/715,162 Page 
Art Unit: 2166 

"second instructions for generating a time bar that divides time into 
segments having a size that depends upon the media files associated with 
the respective segment of time" as the temporal metadata associated with the 
photos can be used to present a histogram of photos in the form of a timeline 250 
shown in fig 1 . The timeline 250 can show the number of photos take as function 
of time over some period of time that can rage from the time the first photo in the 
database was taken to the present. The timeline 250 can be used by itself, or 
with other tags 350 to specify the criteria used to search for matching photos. 
The timeline includes adjustable time bands 251 that can be moved to allow 
timeline 250 to specify the time period that is used to find matching photos 
(Rothmuller Page 7, Lines 27-31 & Page 8, Lines 1-3). Examiner interprets the 
segments as time bands having a size/time period and media files associated 
with that size. 

"a display in communication with the processing unit that presents a 
combined view of the media view and the time bar" as figurel , which shows 
the combined view of both the media view and the time bar (Rothmuller Figure 
1). 

Claim 13 is essentially the same as claim 1 1 except it recites the claimed 
invention as a method and is rejected for the same reasons as applied herein 
above. 
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With respect to claim 16, Rothmuller teaches a method for using a time 
bar in a media diary application to access a media file, the method 
comprising: 

"providing the user of a digital device a display of a time bar and a 
media view that represents media files in association with a predefined 
time" as the temporal metadata associated with the photos can be used to 
present a histogram of photos in the form of a timeline 250 shown in fig 1 . The 
timeline 250 can show the number of photos take as function of time over some 
period of time that can rage from the time the first photo in the database was 
taken to the present. The timeline 250 can be used by itself, or with other tags 
350 to specify the criteria used to search for matching photos. The timeline 
includes adjustable time bands 251 that can be moved to allow timeline 250 to 
specify the time period that is used to find matching photos (Rothmuller Page 7, 
Lines 27-31 & Page 8, Lines 1-3). Figure 1, Image area 100 provides a media 
view (Rothmuller Figure 1) 

"activating one or more time levels of the time bar to display the 
specific predefined time for which a media file is associated" as the timeline 
250 can be used by itself to find all photos taken between Jan 1, 2000 and Feb 
28, 2000 by moving the adjustable time bands 251 to these two respective dates 
(Rothmuller Page 8, Lines 8-10). The time levels of timeline shown in the 
reference has 2000 as year level, Jan as month level and 1 st as day level and 
these levels are being activated to retrieve media files. 
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"activating the specific period of time to display a representation of 
the media file and the associated predefined time" as the timeline 250 can be 
used by itself to find all photos taken between Jan 1, 2000 and Feb 28, 2000 by 
moving the adjustable time bands 251 to these two respective dates (Rothmuller 
Page 8, Lines 8-10). 

"selecting the representation of the media file to access the media 
file" as the timeline 250 can be used by itself, or with other tags 350 to specify 
the criteria used to search for matching photos (Rothmuller Page 7, Line 31 & 
Page 8, Lines 1-2). 

With respect to claim 17, Rothmuller teaches "the method of claim 16, 
wherein the step of activating one or more time levels of the time bar to 
display the specific predefined time for which a media file is associated 
further comprises activating one or more time levels of the time bar chosen 
from the group consisting of month level, week level and day level to 
display the specific predefined time for which a media file is associated" as 
the timeline 250 can be used by itself to find all photos taken between Jan 1 , 
2000 and Feb 28, 2000 by moving the adjustable time bands 251 to these two 
respective dates (Rothmuller Page 8, Lines 8-10). The time levels of timeline 
shown in the reference has 2000 as year level, Jan as month level and 1 st as day 
level and these levels are being activated to retrieve media files. 
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With respect to claim 18, Rothmuller teaches "the method of claim 16, 
wherein the step of activating the specific predefined time to display a 
representation of the media file and the associated predefined time further 
comprises activating a specific date to display a representation of the 
media file and the date" as the timeline 250 can be used by itself to find all 
photos taken between Jan 1, 2000 and Feb 28, 2000 by moving the adjustable 
time bands 251 to these two respective dates (Rothmuller Page 8, Lines 8-10). 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 1 02 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Rothmuller et al. (International Pub No. WO 02/057959 A2). 

With respect to claim 12, Rothmuller teaches "the digital device of 
claim 11, wherein the processing unit that executes computer-readable 
program instructions for accessing media files, the computer-readable 
program instructions comprising further comprises a third instructions for 
generating a calendar view that represents time in calendar format, 
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associates events with respective periods of time" as in addition to timelines, 
the temporal distribution of objects in the database can be represented in a 
calendar view such that the days of the calendar indicate the number of objects 
having metadata associated with a given day of the week in a given week of the 
month (Rothmuller Page 3, Lines 10-16). In addition tags in the events category 
can include pre-defined calendar event such as New Years Eve, and customized 
calendar events such as birthdays and anniversaries (Rothmuller Page 5, Lines 
21-23). 

Rothmuller teaches the elements of claim 12 as noted above but does 
not explicitly teach "and is presented by the display in combination with the 
media view and the time bar." 

However, Rothmuller teaches "and is presented by the display in 
combination with the media view and the time bar" as figurel, which shows 
the combined view of both the media view and the time bar (Rothmuller Figure 
1). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited reference because 
these teachings would have provided the display of all the files and events 
associated with a specific data by the displaying calendar events with 
combination to media view and time bar, thereby limiting the search time of 
different files and events. 
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Contact Information 

8. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Usmaan Saeed whose telephone number is 
(571)272-4046. The examiner can normally be reached on M-F 8-5. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Hosain Alam can be reached on (571)272-3978. The fax 
phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). 
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